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Abstract. We obtain new connections between permutation patterns and sin- 
gularities of Schubert varieties, by giving a new characterization of Gorenstein 
varieties in terms of so called bivincular patterns. These are generalizations of 
classical patterns where conditions are placed on the location of an occurrence 
in a permutation, as well as on the values in the occurrence. This clarifies 
what happens when the requirement of smoothness is weakened to factori- 
ality and further to Gorensteinness, extending work of Bousquet-Melou and 
Butler (2007), and Woo and Yong (2006). We also show how mesh patterns, 
introduced by Branden and Claesson (2011), subsume many other types of 
patterns and define an extension of them called marked mesh patterns. We 
use these new patterns to further simplify the description of Gorenstein Schu- 
bert varieties and give a new description of Schubert varieties that are defined 
by inclusions, introduced by Gasharov and Reiner (2002). We also give a 
description of 123-hexagon avoiding permutations, introduced by Billey and 
Warrington (2001), Dumont permutations and cycles in terms of marked mesh 
patterns. 



1. Introduction 

In this paper we exhibit new connections between permutation patterns and sin- 
gularities of Schubert varieties in the complete flag variety Flags(C"), by giving 
a new characterization of Gorenstein varieties in terms of which bivincular pat- 
terns the permutation ir avoids. Bivincular patterns, defined by Bousquet-Melou, 
Claesson, Dukes and Kitaev [TJ, are generalizations of classical patterns where con- 
ditions are placed on the location of an occurrence in a permutation, as well as on 
the values in the occurrence. This clarifies what happens when the requirement 
of smoothness is weakened to factoriality and further to Gorensteinness, extending 
work of Bousquet-Melou and Butler [5] , and Woo and Yong [37j . We also prove re- 
sults that translate some known patterns in the literature into bivincular patterns. 
In particular we will give a characterization of the Baxter permutations. 

Table [I] summarizes the main results in the paper related to bivincular patterns. 
The first line in the table is due to Ryan [55], Wolper and Lakshmibai and 
Sandhya [TH] and says that a Schubert variety X x is non-singular (or smooth) if 
and only if ir avoids the patterns 1324 and 2143. Note that some authors use a 
different convention for the correspondence between permutations and Schubert 
varieties, which results in the reversal of the permutations. These authors would 
then use the patterns 4231, 3412 to identify the smooth Schubert varieties. Saying 
that the variety X„ is non-singular means that every local ring is regular. 

A weakening of this condition is the requirement that every local ring only 
be a unique factorization domain; a variety satisfying this is a factorial variety. 
Bousquet-Melou and Butler [5] proved a conjecture stated by Woo and Yong (per- 
sonal communication) that factorial Schubert varieties are those that correspond 
to permutations avoiding 1324 and bar-avoiding 21354. In the terminology of Woo 
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Table 1. Connections between singularity properties and bivin- 
cular patterns 



X v is 


The permutation 


tt avoids the patterns 


smooth 


2143 and 1324 




factorial 


2143 and 1324 




Gorenstein 


12345 12345 
31524' 24153 


and associated Grassmannians avoid 
two bivincular pattern families 



and Yong [57] the bar-avoidance of the latter pattern corresponds to avoiding 2143 
with Bruhat restriction (lf>4), or equivalently, interval avoiding [2413, 2143] in the 
terminology of Woo and Yong [55]. However, as remarked by Steingrimsson [2"3"j . 
bar-avoiding 21354 is equivalent to avoiding the vincular pattern 2143. See Theo- 
rem [7] for the details. 

A further weakening is to only require that the local rings of X n be Gorenstein 
local rings, in which case we say that X n is a Gorenstein variety. Woo and Yong [27) 
showed that X^ is Gorenstein if and only if it avoids two patterns with two Bruhat 
restrictions each, as well as satisfying a certain condition on descents. We will 



translate their results into avoidance of bivincular patterns; see Theorem 19 

We also show how mesh patterns, introduced by Branden and Claesson [SJ , sub- 
sume many other types of patterns, such as interval patterns defined by Woo and 
Yong [28], and define an extension of them called marked mesh patterns. We use 
these new patterns to further simplify the description of Gorenstein Schubert va- 



rieties (see Theorem 27 ) and give a new description of Schubert varieties that are 



defined by inclusions, introduced by Gasharov and Reiner [12j (see Theorem 26). 
We also give a description of 123-hexagon avoiding permutations, introduced by 
Billey and Warrington [3J, in terms of the avoidance of 123 and one marked mesh 



pattern (see Proposition |28[ ). Finally, in Example 20, we describe Dumont permu- 
tations 1 11 j (of the first and second kind) and cycles with marked mesh patterns. 

2. Three types of pattern avoidance 

Here we recall definitions of different types of patterns. We will use one-line 
notation for all permutations, e.g., write tt = 312 for the permutation in S3 that 
satisfies 7r(l) = 3, 7r(2) = 1 and 7r(3) = 2. 

The three types correspond to: 

• Bivincular patterns, subsuming vincular patterns and classical patterns. 

• Barred patterns. 

• Bruhat-restricted patterns. 

2.1. Bivincular patterns. We denote the symmetric group on n letters by S n 
and refer to its elements as permutations. We write permutations as words tt — 
a\CL2 ■ ■ ■ a n , where the letters are distinct and come from the set {1, 2, . . . , n}. A 
pattern p is also a permutation, but we are interested in when a pattern is contained 
in a permutation tt as described below. 

An occurrence (or embedding) of a pattern p in a permutation tt is classically 
defined as a subsequence in tt, of the same length as p, whose letters are in the same 
relative order (with respect to size) as those in p. For example, the pattern 123 
corresponds to an increasing subsequence of three letters in a permutation. If we 
use the notation l v to denote the first, 2^ for the second and 3 T for the third letter 
in an occurrence, then we are simply requiring that l n < 2^ < 3„-. If a permutation 
has no occurrence of a pattern p we say that tt avoids p. 
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Table 2. Connections between singularity properties and marked 
mesh patterns 
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smooth 
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Example 1. The permutation 324f 5 contains two occurrences of the pattern 123 
corresponding to the sub-words 345 and 245. It avoids the pattern 132. 

The occurrence of a pattern in a permutation 7r can also be defined as a subset 
of the diagram G(p) — | 1 < i < n}, that "looks like" the diagram of the 

pattern. Below is the diagram of the pattern 123 and two copies of the digram of 
the permutation 32415 where we have indicated the two occurrences of the pattern 
by circling the dots. 




In a vincular pattern two adjacent letters may or may not be underlined. If they 
arc underlined it means that the corresponding letters in the permutation 7r must 
be adjacent. 

Example 2. The permutation 32415 contains one occurrence of the pattern 123 
corresponding to the sub-word 245. It avoids the pattern 123. The permutation 
7T = 324615 has one occurrence of the pattern 2143, namely the sub-word 3265, but 
no occurrence o/2143, since 2 and 6 are not adjacent in tt. 

It is also convenient to consider vincular patterns as certain types of diagrams. 
We use dark vertical strips between dots that are required to be adjacent in the 
pattern. Notice that only the second occurrence of the classical pattern 123 satisfies 
the requirements of the vincular pattern, since in the former the dot corresponding 
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to 2 in 7r lies in the forbidden strip. 






These types of patterns have been studied sporadically for a very long time but 
were not defined in full generality until Babson and Steingrimsson [T]. 

This notion was generalized further in Bousquet-Melou et al [7]: In a bivincular 
pattern we are also allowed to place restrictions on the values that occur in an 
embedding of a pattern. We use two-line notation to describe these patterns. If 
there is a line over the letters i, i+1 in the top row, it means that the corresponding 
letters in an occurrence must be adjacent in values. This is best described by an 
example: 

123 

Example 3. An occurrence of the pattern ^23 * n a permutation it is an increasing 

subsequence of three letters, such that the third one is larger than the second by 
exactly 1, or more simply, 3^ = 2^ + 1. The permutation 32415 contains two 
occurrence of this bivincular pattern corresponding to the sub-words 345 and 245. 

The second one is also an occurrence of j^jj • The permutation avoids the bivincular 

123 
pattern ^ 2 3 ■ 

By also using horizontal strips we are able to draw diagrams of bivincular pat- 

123 

terns. Below is the diagram of ^23 together with one occurrence of it. 



m 





We will also use the notation of [7] to write bivincular patterns: A bivincular 
pattern consists of a triple (p, X, Y) where p is a permutation in Sk and X, Y are 
subsets of [0, kj = {0, ...,k}. With this notation an occurrence of a bivincular 
pattern in a permutation n = m ■ ■ ■ n n in S n is a subsequence ir il ■ ■ ■ ir ik such that 
the letters in the subsequence are in the same relative order as the letters of p and 

• for all x in X, i x +\ = i x + 1; and 

• for all y in Y, j y+ i = j y + 1, where {tt^ , . . . , 7r ifc } = {ji,...,jk} and 
h < h < ■ ■ ■ < jk- 

By convention we put io = = jo and ik+i = n + 1 = jk+i- 

Example 4. We can translate all of the patterns we have discussed above into this 
notation: 



123 = (123,0,0), 132 = (132,0,0), 
123 = (123, {2}, 0), 2143 = (2143,0,0), 



HI =(123,0, {1}), 



123 
123 



123 = (123,{1},0), 
2143 = (2143, {2}, 0), 

123 



(123,0, {1,2}), 123 =(123, {2}, {1,2}). 



We have not considered the case when or A are elements of X or Y, as we will 
not need those cases. We just remark that if G X then an occurrence of (p, X, Y) 
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must start at the beginning of a permutation tt, in other words, tt^ — tt\. The 
other cases are similar. 

The bivincular patterns behave well with respect to the operations reverse, com- 
plement and inverse: Given a bivincular pattern (p, X, Y) we define 

(p, X, Yf = (?, k-X,Y) t (p, X, Y) c = (p c , X, k - Y), 

(p,X,YY = (p\Y,X), 

where p r is the usual reverse of the permutation p, p c is the usual complement of 
the permutation p, and p 1 is the usual inverse of the permutation p. Here k — M = 
{k — m\ m € M}. In [B] the following is proved. 

Lemma 5. Let a denote one of the operations above, or a composition of them. 
Then a permutation tt avoids the bivincular pattern p if and only if the permutation 
7r a avoids the bivincular pattern p 3, . 

2.2. Barred patterns. We will only consider a single pattern of this type, but the 
general definition is easily inferred from this special case. We say that a permutation 
tt avoids the barred pattern 21354 if tt avoids the pattern 2143 (corresponding to 
the unbarred elements) except where that pattern is a part of the pattern 21354. 
This notation for barred patterns was introduced by West [25,. It turns out that 
avoiding this barred pattern is equivalent to avoiding the vincular pattern 2143; 
see section [3] See also section [4] on how to write barred patterns as mesh patterns. 

Example 6. The permutation tt — 4257613 avoids the barred pattern 21354 since 
the unique occurrence of 2143, as the sub-word 4276, is contained in the sub-word 
42576 which is an occurrence of 21354. Note that it also avoids 2143. 

2.3. Bruhat-restricted patterns. We recall the definition of Bruhat-restricted 
patterns from Woo and Yong [57] . First we need the Bruhat order on permutations 
in S n , defined as follows: Given integers i < j in [1, n] and a permutation tt 6 S n 
we define w(i <-> j) as the permutation that we get from tt by swapping ir(i) and 
7r(j). For example 24153(1 <-> 4) = 54123. We then say that n(i <-> j) covers tt 
if 7r(i) < tt(J) and for every k with i < k < j we have either 7r(fc) < tt(i) or 
Tv(k) > 7r(j). We then define the Bruhat order as the transitive closure of the above 
covering relation. This definition should be compared to the construction of the 



graph Gtt in subsection 3.1 We see that in our example above that 24153(1 ■(-> 4) 
does not cover 24153 since we have 7r(2) = 4. Now, given a pattern p with a set of 
transpositions T = {{ie 4 ^ je)} we say that a permutation tt contains (p,T), or that 
tt contains the Bruhat-restricted pattern p (if T is understood from the context), 
if there is an embedding of p in tt such that if any of the transpositions in T are 
carried out on the embedding the resulting permutation covers tt. 

We should note that Bruhat-restricted patterns were further generalized to in- 
tervals of patterns in Woo and Yong [28^ . We delay the discussion of this type of 
pattern avoidance until section |4j where we also introduce mesh patterns and show 
that an interval pattern is a special case of a mesh pattern. 

In the next section we will show how these three types of patterns are related to 
one another. 

3. Connections between the three types 

3.1. Factorial Schubert varieties and forest-like permutations. Bousquet- 
Melou and Butler [5] defined and studied forest-like permutations. Here we recall 
their definition: Given a permutation tt in S n , construct a graph on the vertex 
set {1, 2, . . . , n} by joining i and j if 

(1) i < j and tt(i) < 7r(j); and 
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avoiding 
21354 



avoiding 
2143 

II 

@ 

II 

avoiding 
2143, (2H-3) 







avoiding 
2143, (1-H4) 

12) 

avoiding 

1234 
2143 



Figure 1. The barred pattern 21354 gives a connection between 
two bivincular patterns. The labels on the edges correspond to the 
enumerated list below 



(2) there is no k such that i < k < j and ir(i) < 7r(fc) < Tr(j). 

The permutation tt is forest-like if the graph is a forest. In light of the definition 
of Bruhat covering above we see that the vertices i and j are connected in the graph 
of Gtt if and only if 7r(i-H>j) covers tt. 

They then show that a permutation is forest-like if and only if it avoids the 
classical pattern 1324 and the barred pattern pbar = 21354. This barred pattern can 
be described in terms of Bruhat-restricted embeddings and in terms of bivincular 
patterns, as we now show. 

(1) Bousquet-Melou and Butler [5] remark that forest-like permutations tt cor- 
respond to factorial Schubert varieties X T and avoiding the barred pattern 
is equivalent to avoiding pBr = 2143 with Bruhat restriction (lf>4). This 
last part is easily verified. 

(2) Avoiding p^ r — 2143 with Bruhat restriction (l<->4) is equivalent to avoid- 

1234 

ing the bivincular pattern p D i = 2143 > as we wm now snow: 

Assume tt contains the bivincular pattern p D i, so we can find an embed- 
ding of it in tt such that 3 W = 2^ + 1. This embedding clearly satisfies the 
Bruhat restriction. 

Now assume that tt has an embedding of pbt- If 3^ = 2^ + 1 we are done. 
Otherwise 2 n + 1 is either to the right of 3^ or to the left of 2^ (because 
of the Bruhat restriction). In the first case change 3^ to 2 ff + 1 and we are 
done. In the second case replace 2 W with 2 W + 1, thus reducing the distance 
in values to 3^, then repeat. 

(3) The barred pattern p D ar = 21354 has another connection to bivincular 
patterns: avoiding it is equivalent to avoiding the bivincular pattern <7biv = 
2143, as remarked in the survey by Steingrimsson 23 . 

(4) We can translate this into Bruhat-restricted embeddings as well: Avoiding 
the bivincular pattern gbi = 2143 is equivalent to avoiding q^ r = 2143 with 
Bruhat restriction (2-0-3): 

Assume tt has an embedding of q^. If 1^ and 4^ are adjacent then we 
are done. Otherwise look at the letter to right of 1^. If this letter is larger 
than A w we can replace A w by it and we are done. Otherwise this letter 
must be less than 4 W , which implies by the Bruhat restriction, that it must 
also be less than l w . In this case we replace l w by this letter, and repeat. 

Now assume tt has an embedding of the bivincular pattern q^. If l n and 
4,r are adjacent we are done. Otherwise look at the letter to the right of 
In. This letter is either smaller than l w or larger than 4 T . In the first case, 
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replace l ff with this letter; in the second case, replace 4 W with this letter. 
Then repeat if necessary. 
The above argument will be generalized in Proposition |14[ but this special case 
gives us: 

Theorem 7. /f5] , |23] / Let n € S n . The Schubert variety is factorial if and only 
if ir avoids the patterns 2143 and 1324. 

From the equivalence of the patterns in Figure [T] we also get that a permutation 
tt avoids the bivincular pattern 

2143 = (2143, {2}, 0) 

if and only if it avoids 

2X43 =(2143,0, {2}). 

We will prove this without going through the barred pattern, and then generalize 
the proof, but first of all we should note that these bivincular patterns are inverses 
of one another, and that will simplify the proof. 
1234 

Assume tt contains 2143 • If l^r and 4^ are adjacent in tt we are done. Otherwise 
consider the element immediately to the right of l w . If this element is less than 2^ 
then replace l ff by it and we will have reduced the distance between l ff and 4 ff . If 
this element is larger than 2„ it must also be larger than 3^, since 3^=2^ + 1, 
so replace 4 T by it. This will (immediately, or after several steps) produce an 
occurrence of 2143. 

Now assume tt contains 2143. Then tt 1 contains the inverse pattern 

(2143) 1 =^t. 

• • 1234 
Then by the above, tt 1 contains 2143, so tt — (tt 1 ) 1 contains (2143) 1 = 2143 ■ 

This generalizes to: 
Proposition 8. Let p be the pattern 

■■■Ik--- = (■■■Ik--- ,{j},0) 

in Sk, where j — p'(l) is the index of 1 in p. A permutation tt in S n that avoids 
the pattern p must also avoid the bivincular pattern 

12 : lk : =(---ik--- ,0,(2,3,. ..,^-2}). 

Proof. Assume a permutation tt contains the latter pattern in the proposition. If l n 
and fc^ are adjacent in tt we are done. Otherwise consider the element immediately 
to the right of 1^. If this element is larger than (fc — l) w we replace k^ by it and are 
done. Otherwise this element must me less than (k — l) v and therefore less than 
2„, so we can replace l ff by it, and repeat. □ 

By applying the reverse to everything in Proposition [8] we get: 

Corollary 9. Let p be the pattern 

■ ■ -kl- ■ ■ = (•••fcl-- - ,{j},0) 

in Sk, where j = p 1 (k) is the index of k in p. A permutation tt in S n that avoids 
the pattern p must also avoid the bivincular pattern 



12 : kl :: k =(---ki--- ,0,(2,3,.. .^-2}). 
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By repeatedly applying the operations of inverse, reverse and complement we 
can generate six other corollaries. We will not need them here. 

Example 10. Let's look at some simple applications: 

(1) Consider the bivincular pattern pi = 3142. Proposition^ shows that a 

permutation tt that avoids p\ must also avoid 3^42- In fact, the converse 
can be shown to be true, by taking inverses and applying the proposition. 
We will say more about the pattern p\ in Example \11\ 

(2) Consider the bivincular pattern p2 = 31524. The proposition shows that 

1 234 5 

a permutation n that avoids p^ must also avoid 31524 • We w ^ sa D more 



about the pattern P2 in subsection 3.2 



Example 11. The Baxter permutations were originally defined and studied in 
relation to the "commuting function conjecture " of Dyer, see Baxter [2 , and were 
enumerated by Chung, Graham, Hoggatt and Kleiman [5]. Gire [T3] showed that 
these permutations can also be described as those avoiding the barred patterns 41352 
and 25134. It was then pointed out by Ouchterlony |21j that this is equivalent to 
avoiding the vincular patterns 3142 and 2413 . 

Similarly to what we did above we can show that the Baxter permutations can 

1234 1234 

also be characterized as those avoiding the bivincular patterns 3142 and 2413 > an< ^ 
this is essentially a translation of the description in [S] into bivincular patterns. 

Finally, here is an example that shows the converse of Proposition [8] is not true. 

12345 

Example 12. The permutation tt — 423165 avoids the pattern 23154 but contains 
the pattern 23154, as the sub-word 23165. 

3.2. Gorenstein Schubert varieties in terms of bivincular patterns. Woo 

and Yong |27] classify those permutations tt that correspond to Gorenstein Schubert 
varieties X„. They do this using embeddings of patterns with Bruhat restrictions, 
which we have described above, and with a certain condition on the associated 
Grassmannian permutations of tt, which we will describe presently: 

First, a descent in a permutation tt is an integer d such that Tr(d) > ir{d + 1), 
or equivalently, the index of the first letter in an occurrence of the pattern 21. 
A Grassmannian permutation is a permutation with a unique descent. Given any 
permutation tt we can associate a Grassmannian permutation to each of its descents 
as follows: Given a particular descent d of tt we construct the sub-word 7^(71") by 
concatenating the right-to- left minima of the segment strictly to the left of d+1 with 
the left-to-right maxima of the segment strictly to the right of d. More intuitively 
we start with the descent TT(d)n(d+l) and enlarge it to the left by adding decreasing 
elements without creating another descent and similarly enlarge it to the right by 
adding increasing elements without creating another descent. We then denote the 
flattening (or standardization) of 7d(7r) by 7d(7r), which is the unique permutation 
whose letters are in the same relative order as 7d (?>")■ 

Example 13. Consider the permutation tt — 11|6|12|94153728|10 where we have 
used the symbol \ to separate two-digit numbers from other numbers. For the de- 
scent atd = 4 we get 74(77) = 694578|10 and 74(71-) = 3612457. 

Now, given a Grassmannian permutation p in S n with its unique descent at d 
we construct its associated partition \(p) as the partition inside a bounding box 
d x (n — d), with d rows and n — d columns, whose lower border is the lattice path 
that starts at the lower left corner of the bounding box and whose i-th step, for 
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i G [ljTi], is vertical if i is weakly to the left of the position d, and horizontal 
otherwise. A corner of the lattice path is called an inner corner if it corresponds to 
a right turn on the path, otherwise it is called an outer corner. We are interested 
in the inner corner distances of this partition, that is, for every inner corner we 
add its distance from the left side and the distance from the top of the bounding 
box. If all these inner corner distances are the same then the inner corners all lie 
on the same anti-diagonal. 

In Theorem 1 of Woo and Yong [27] they show that a permutation ir E S n 
corresponds to a Gorenstein Schubert variety X v if and only if 

(1) for each descent d of tt, A(7d(7r)) has all of its inner corners on the same 
anti-diagonal; and 

(2) the permutation tt avoids both 31524 and 24153 with Bruhat restrictions 
{(l-H-5), (2<H-3)} and {(l-H-5), (3«4)}, respectively. 

Let's take a closer look at condition [2j Proposition [14"| below shows that avoiding 
31524 with Bruhat restrictions {(1 4-> 5), (2 -H> 3)} is equivalent to avoiding the 
bivincular pattern 

31524 =(31524,{2},{3})- 

Similarly, avoiding 24153 with Bruhat restrictions {(lf>5),(3f>4)} is equivalent 
to avoiding the bivincular pattern 

24153 =(24153,{3},{2». 

Proposition 14. (1) Let p be the pattern 

■■■Ik--- 

in Sk- Let j — p 1 (1) be the index of 1 in p. A permutation tt in S n avoids 
p with Bruhat restriction (j O j + 1) if and only if tt avoids the vincular 
pattern 

■■■Ik--- :•••!/■•••• ,{j},0). 
(2) Let £ £ [1, k — 1] and p be the pattern 

£■■■(1 + 1) 

in Sk- A permutation tt in S n avoids p with Bruhat restriction (1 •<->■ k) if 
and only if tt avoids the bivincular pattern 

Proof. We consider each case separately. 

(1) Assume tt contains the vincular pattern mentioned. Then it clearly also 
contains an embedding satisfying the Bruhat restriction. 

Conversely assume tt contains an embedding satisfying the Bruhat re- 
striction. If ljr and k^ are adjacent then we are done. Otherwise look at the 
element immediately to the right of 1^. This element must be either larger 
than kit, in which case we can replace k v by it and are done, or smaller, in 
which case we replace 1^ by it, and repeat. 

(2) Assume tt contains the bivincular pattern mentioned. Then it clearly also 
contains an embedding satisfying the Bruhat restriction. 

Conversely assume tt contains an embedding satisfying the Bruhat re- 
striction. If {£ + 1)^. = t v + 1 then we are done. Otherwise consider the 
element £^ + 1. It must either be to the right of (£ + 1)^ or to the left of 
£„. In the first case we can replace (£ + l) w by £ r! + 1 and be done. In the 
second case replace £„ with £„ + 1 and repeat. □ 



10 



HENNING ULFARSSON 



As a consequence we get: 
Corollary 15. A permutation n in S n avoids 

•••!/•••••• (i^i + i), 

where j is the index of 1, if and only if the inverse ir 1 avoids 

i • • • (i + 1), (!«*)■ 

Note that we could have proved the statement of the corollary without going 
through bivincular patterns and then used that to prove part [2] of Proposition |14| 
as part [2] is the inverse statement of the statement in part [I] 

Translating condition [I] of Theorem 1 of Woo and Yong [27] into bivincular 
patterns is a bit more work. The failure of this condition is easily seen to be 
equivalent to some partition A of an associated Grassmannian permutation "fd{^) 
having an outer corner that is either "too wide" or "too deep". More precisely, 
given a Grassmannian permutation p and an outer corner of X(p), we say that it 
is too wide if the distance upward from it to the next inner corner is smaller than 
the distance to the left from it to the next inner corner. Conversely we say that an 
outer corner is too deep if the distance upward from it to the next inner corner is 
larger than the distance to the left from it to the next inner corner. We say that 
an outer corner is unbalanced if it is either too wide or too deep. We say that an 
outer corner is balanced if it is not unbalanced. 

If a permutation has an associated Grassmannian permutation with an outer 
corner that is too wide we say that the permutation itself is too wide and similarly 
for too deep. If the permutation is cither too wide or too deep we say that it is 
unbalanced, otherwise it is balanced. It is time to see some examples. 

Example 16. See Figure^ for drawings of the partitions below. 

(1) Consider the permutation p = 14235 with a unique descent at d = 2. It 
corresponds to the partition (2) C 2 x 3 and has just one outer corner. This 
outer corner is too wide. 

(2) Consider the permutation p — 13425 with a unique descent at d = 3. It 
corresponds to the partition (1,1) C 3 x 2 and has just one outer corner. 
This outer corner is too deep. 

(3) Consider the permutation p = 134892567|10 with a unique descent at d = 5. 
It corresponds to the partition (4, 4, 1,1) C 5x5 and has two outer corners. 
The first outer corner is too deep and the second is too wide. 

(4) Consider the permutation p — 13672458 with a unique descent at d = 4. It 
corresponds to the partition (3, 3, 1) C 4 x 4 and has two outer corners that 
are both balanced. 



Figure 2. The associated partitions of the permutations in Ex- 
ample |T6| 

We now show how these properties of Grassmannian permutations can be de- 
tected with bivincular patterns. 

Lemma 17. Let p be a Grassmannian permutation. 
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(1) The permutation p is too wide if and only if it contains at least one of the 
bivincular patterns from the infinite family 



t- J 12345 1234567 123456789 
= | 14235' 1562347' 167823459' 

The general member of this family is of the form 



12 k 

!£+!■ -2 - - Ik- 



where £ = (k + l)/2, and k is odd. 
(2) The permutation p is too deep if and only if it contains at least one of the 
bivincular patterns from the infinite family 



r J 12345 1234567 123456789 
y = \ 13425' 1456237' 156782349' 

The general member of this family is of the form 



12 k 

ie+1- '2"tk- 



where £ = (k — l)/2, and k is odd. 

Note that these two infinite families can be obtained from one another by reverse 
complement. 

Proof. We only consider part [l] as part [2] is proved analogously. Assume that p is 
a Grassmannian permutation that is too wide, so it has an outer corner that is too 
wide. Let I be the distance from this outer corner to the next inner corner above. 
Then the distance from this outer corner to the next inner corner to the left is at 
least I + 1. This allows us to construct an increasing sequence t of length £ in p, 
starting at a distance at least two to the right of the descent. We can also choose 
t so that every element in it is adjacent both in location and values. Similarly we 
can construct an increasing sequence s of length £ in p, located strictly to the left 
of the descent. We can also choose s so that every element in it is adjacent both in 
location and values. This produces the required member of the family J- . 

Conversely, assume p contains the i-th member of the family J- ', the pattern 



12 k 

1£+1- '2"£k-- 



where k = 2i + 3. Then the occurrence of the pattern corresponds to an outer 
corner in the partition of p of width £ — 1 and depth £ — 2. □ 

We have now shown that: 

Proposition 18. A permutation tt is balanced if and only if every associated Grass- 
mannian permutation avoids every bivincular pattern in the two infinite families T 



and Q in Lemma 17 
This gives us: 

Theorem 19. Let tt 6 S n . The Schubert variety is Gorenstein if and only if 

(1) tt is balanced; and 

(2) the permutation tt avoids the bivincular patterns 

12345 , 12345 
31524 and 24153- 
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With these descriptions of factorial and Gorenstein varieties it is simple to show 
that smoothness implies factoriality, which implies Gorensteinness: If a variety is 
not factorial it contains either 2143 or 1324, so it must contain either 2143 and 
1324 and is therefore not smooth. If a variety is not Gorenstein then at least one 
of the following are true, 

(1) 7r has an associated Grassmannian permutation that contains one of the 
bivincular patterns in the infinite families J- and Q so it also contains 1324 
and is therefore not factorial. 

12345 12345 

(2) 7r contains 31524 or 24153 > so ^ a ^ so contains 2143 and is therefore not 
factorial. 



4. Mesh patterns and marked mesh patterns 

4.1. Mesh patterns. Branden and Claesson [8 introduced a new type of pattern 
called a mesh pattern and showed they generalize bivincular patterns and (most) 
barred patterns. Here we recall their definition: A mesh pattern is a pair (p, R) 
where p is a permutation of rank k and R is a subset of the square [0, fc] x [0, kj. 
An occurrence of that pattern in a permutation tt is first of all an occurrence of p in 
7T in the usual sense, that is, a subset of the diagram G(w) — {(i, n(i)) \ 1 < i < n}. 
This occurrence must also satisfy the restrictions determined by R, that is, there 
are order-preserving injections a, f3 : [1, fc] — > [l,n] such that if € R then 

Rij n G(tt) is empty, where 

R ij = [a(i) + l,a(i + 1) - 1] x + + 1) - 1]; 

with a(0) = = ,5(0) and a(k + 1) = n + 1 = f3(k + 1). It is best to unwind this 
formal definition with a few examples. 

Example 20. (1) The mesh pattern (21, {(1, 0), (1, 1), (1, 2)}) can be depicted 
as follows: 




An occurrence of this mesh pattern in a permutation is an inversion (an 
occurrence of the classical pattern 21) with the additional requirement that 
there is nothing in between the two elements in the occurrence. We usually 
refer to this pattern as the vincular pattern 21, that is, a descent. 
(2) Now consider the more complicated mesh pattern below. 




There are two occurrences of this mesh pattern in the permutation n — 
315426, shown below. 
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Every other occurrence of the classical pattern 12 in it, e.g. 




fails to satisfy the requirements given, since some of the shaded areas will 
have a dot in them. 

(3) Dukes and Reifegerste [10] defined certified non-inversions as occurrences 
of 132 that are neither part of 1432 nor 1342. Equivalently these are occur- 
rences of the mesh pattern below. 



Branden and Claesson [8] showed that a barred pattern with only one barred 
letter can be written as a mesh pattern^] The procedure is as follows: If n(i) is 
the only barred letter in a barred pattern tt then the corresponding mesh pattern 
is (tt', {(i — 1, tt(i) — 1)}) where tt' is the standardization of tt after the removal of 
7r(i). For example 



123 



More general barred patterns can be also be translated into mesh patterns as long as 
the barred letters are neither adjacent in locations nor in values. The procedure is 
essentially the same as above, so for example the barred pattern 634125 is contained 
in a permutation tt if and only if at least one of the mesh patterns 










+ 


< 


• 


















— < 

























+ 


< 


1 


















— 1 


1— 













is contained in tt. 

It is possible to classify simsun permutations by the avoidance of mesh patterns 
as follows: A permutation in S n is simsun if it contains no double descent ( 321 ) 
in any of its restrictions to the interval [l,fc] for some k < n. For example the 
permutation 452613 is not simsun since if we restrict it to [1,4] it becomes 4213 
which contains a double descent. It is now almost trivial to check that a permutation 
is simsun if and only if it avoids the mesh pattern 




This was also noticed independently and simultaneously by Branden and Claes- 
son [8]. 

It is easy to see that bivincular patterns are special cases of mesh patterns. 
Adjacency conditions on positions in the bivincular pattern become vertical strips, 
while adjacency conditions on values become horizontal strips; R is then the union 



This had been noticed earlier as well, see unpublished work of Isaiah Lankham. 
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19 



12345 

of all the strips. For example the bivincular pattern 3^524 from Theorem 
corresponds to the mesh pattern 



(1) 



We have seen in Proposition [14] that some Bruhat-restricted patterns can be 
turned into bivincular patterns. We now show that any Bruhat-restricted pattern 
can be turned into a mesh pattern. 

Given a pattern p with one Bruhat restriction (a 4->b) first note that this means 
that a < b and p(a) < p(b) . Then a permutation contains p with the restriction if 
and only if it contains the mesh pattern (p,R), where R consists of all the squares 
in the region with corners (o,7r(a)), (6, 7r(a)), (b, ir(b), (a,n(b)). For example the 
pattern 31524, (lf>5) corresponds to 




(2) 



















— 1 


















1 — 


< 














— 1 














i— 









Given a pattern p with multiple Bruhat restrictions we superpose the mesh patterns 
we get for each individual restriction. For example the pattern 31524, (1 f> 5), 
(3f>4), which is one of the patterns that determines whether a permutation is 
Gorenstein or not, corresponds to 



(3) 



Recall that we had already shown (Proposition ]14]) that this Bruhat-restricted 
pattern corresponds to the bivincular pattern ([I]). It is easy to see directly that 
the mesh pattern ^ is equivalent to the bivincular pattern ([I]) , in terms of being 
contained/avoided by a permutation. 

It is now possible to translate Theorem [19] into mesh patterns, and completely 
get rid of the middle step of considering the Grassmannian subpermutations. But 
this was essentially done in Woo and Yong |28j using interval patterns, which we 
now show to be special cases of mesh patterns. 



4.2. Interval patterns. Woo and Yong [28 defined the avoidance of interval pat- 
terns as a generalization of Bruhat-restricted patterns. We recall the definition 
here, with the modification that we reverse the usual Bruhat order on S n . We 
do this so the definition can be directly compared with the definition of Bruhat- 
restricted avoidance. The (reversed) Bruhat order on S n is the partial order defined 
by p < tt if tt can be obtained from p by composing with a transposition and tt has 
more non-inversions than p. Recall that a non-inversion is an occurrence of the 
classical pattern 12; we let £(ir) denote the number of non-inversions in tt. Now we 
say that a permutation tt contains the interval [p, q] if there exists a permutation 
p < tt and a common embedding of p into p and q into tt such that the entries 
outside of the embedding agree and the posets [p, q], [p,tt] are isomorphic. 
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Example 21. The interval pattern [41523, 31524] corresponds to the Bruhat-restricted 
pattern 31524, (lf->5), shown as a mesh pattern above, and [45123,31524] to 
31524, (l-H-5), (3-H-4) also shown above, 

To show that any interval pattern can be turned into a mesh pattern we need 
a preliminary definition: Given a permutation 7r of rank n and integers j, k £ 
[l,n + l], we define a new permutation it (Bj k of rank n + 1 as follows: 



1 



n(£) 
k 

n(£-l) 



if I < j and ir(£) < k, 
ii£<j and n(£) > k, 

if I > j and tt(£) < k, 
ii£>j and n(£) > k. 



For example 34125 © 3 4 = 354126. 



Lemma 22. A permutation tt contains an interval pattern [p,q] if and only if it 
contains the mesh pattern (q,R) where R consists of boxes (i,j) such that 

e(q)-£(p)^£(q®ij)-£(p®ij) 

Proof. This lemma is a direct corollary of Lemma 2.1 in Woo and Yong [28 which 
states that an embedding $ of [p, q] into [p, n] is an interval pattern embedding if 
and only if £{q) - £(p) = £(n) - £{p). " □ 

It should be noted that although the general definition of a mesh pattern did not 
exist many authors had drawn diagrams analogous to the diagrams we have been 
drawing for mesh patterns, see e.g., [J], [S]. 

Example 23. To realize the interval [53241,32154] as a mesh pattern we start by 
drawing 53241 with white dots and 32154 with black dots into the same diagram 
and consider the boxes {i,j) that satisfy the condition in the lemma above. 



[53241,32154] = 




[215436, 526413] = 




In Theorem 6.6 of Woo and Yong [28] they show that a permutation n e S n 
corresponds to a Gorenstein Schubert variety X T if and only if n avoids intervals 
of the form 

(1) 9a,b = [(« + 2) ■ ■ • (a + b + 2)1 • • ■ a(a + 1), l(a + 2) ■ ■ • (a + b + 1)2 • • ■ a(a + 
l)(a + b + 2)] for all integers a, b > such that a ^ b, 

(2) h a<b = [(a + 2)(o + 4) • • • (a + b + 3)l(a + b + 4)2 • • • (a + l)(a + 3), (a + 
4) • • • (a + b + 4)(a + 2)(a + 3)1 • • • (a + 1)] for all integers a, b > such that 
either a > or b > 0. 



See Figure |4~2| for some patterns appearing in these two lists. 



4.3. Marked mesh patterns, DBI- and Gorenstein varieties. We introduce 
a generalization of mesh patterns which we call marked mesh patterns and use them 
to give an alternative description of Schubert varieties defined by inclusions, Goren- 
stein Schubert varieties, 123-hexagon avoiding permutations, Dumont permutations 
and cycles in permutations. 
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Figure 3. The first few patterns in Theorem 6.6 of Woo and 
Yong [25J shown as mesh patterns (patterns that are the reverse 
complement of a pattern that has already appeared are omitted) 

Definition 24. A marked mesh pattern (p,C) of rank k consists of a classical 
pattern p of rank k and a collection C which contains pairs (C, Oj) where C is 
a subset of the square [0, fc] x [0,fc], j is a non-negative integer and □ is one 
of the symbols <,=,>. An occurrence of (p, C) in a permutation 7r is first of 
all an occurrence of p in 7r in the usual sense, that is, a subset of the diagram 
G(ir) — {(i,Tv(i)) 1 1 < i < n}. This occurrence must also satisfy the restrictions 
determined by C, that is, there are order-preserving injections a, f3 : [1, fc] —¥ [1, n] 
such that for each pair (C, Dj) we have 

#(C n G(tt)) □ j, 

where 

C'= |J Rij. 

As above, R l3 = \a{i) + 1, a(i + 1) - 1] x l/3(j) + 1, P(j + 1) - 1], with a(0) = = 
/3(0) and a(fc + 1) = n + 1 = /3(k + 1). 

Since regions of the form (C, > j) are the most common we also write them more 
simply as (C, j). 

Example 25. (1) Every mesh pattern (p,R) is an example of a marked mesh 
pattern, we just define C = {(R, =0)}. For example, here is the mesh 
pattern that identifies the simsun permutations, written as a marked mesh 
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pattern. 




(2) Consider the marked mesh pattern 




If a permutation n contains it, it has an occurrence of the classical pattern 
12 where there is at least one element x in the permutation with the property 
that 1 T < x < 2 ff . This is equivalent to saying that n contains at least one 
of the classical patterns 213, 123, 132. 
(3) A fixed point of a permutation is an occurrence of the marked mesh pattern 



for some integer k > 0. This generalizes to occurrences of cycles in a 
permutation. For example, a 2-cycle is an occurrence the marked mesh 
pattern (21, C) where C consists of the four marked regions below 



ft 

=fei 



*3 



for some integers &2 > k\ > 0. These types of patterns can also be ex- 
tended to include unions of cycles and thus subsume the patterns defined in 
McGovern [20] . 

(4) Dumont permutations of the first kind [11) are permutations of even rank 
with the property that every even integer is followed by a smaller integer and 
every odd integer is either the last entry in the permutation or is followed 
by a larger integer. Therefore a permutation is a Dumont permutation of 
the first kind if and only if it avoids the marked mesh patterns 






where k is an odd integer. Note that in the second pattern there is a single 
marked region ({(0, 0), (2, 0)}, —k), consisting of two separated boxes. Simi- 
larly for the third pattern. Dumont permutations of the second kind are also 
defined in [11] . They can also be defined by the avoidance of the marked 
mesh patterns 



=k 










>k 


v J 


) 



where k is an odd integer and £ is an even integer. 
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(5) Green and Losonczy [14] defined freely braided permutations as those per- 
mutations avoiding the classical patterns 3421, 4231, 4312, 4321. Equiva- 
lently, these are the permutations avoiding the marked mesh pattern 



ffl 



marked with a single region consisting of (2,0), (3,0), (1,1), (3,1), (0,2), 
(2,2), (3,0) and (3,1). 
(6) Labelle, Leroux, Pergola and Pinzani [18 defined an inversion of the j-th 
kind in a permutation tt to be a pair of elements tt(s) > Tr(t), with s < t 
and such that there do not exist j distinct indices t + 1 < ti, £2, • • • ,tj < n 
such that 7r(<) > n(ti) for i — 1, . . . , j. Alternatively, an inversion of the 
j-th kind is an occurrence of the marked mesh pattern 



-I 



(7) 



Kitaev, see e.g. [TT], introduced partially ordered patterns (POP) as a 
generalization of vincular patterns. Some POPs can be written as marked 
mesh patterns, e.g., an occurrence of the POP 121 in a permutation means 
the occurrence of either 231 or 132. Therefore 



121 = 



(8) Hou and Mansour |15j studied permutations avoiding ID 23 which are per- 
mutations avoiding the marked mesh pattern 




Gasliarov and Reiner |12| defined Schubert varieties defined by inclusions (or 
just DBI) and characterized them with pattern avoidance of the patterns 24153, 
31524, 426153 and 1324. We now show how the first three of these patterns can be 
represented as two marked mesh patterns. 

Theorem 26. Let tt G S n . The Schubert variety is defined by inclusions if and 
only if the permutation tt avoids the patterns 







— 1 












(— 










— 1 




— 1 


— < 


1 — 












© 





1324. 



Where it should be noted that the first marked mesh pattern is marked with a single 
region, {(1,3), (3, 1)}, consisting of two boxes, and the number of dots in this region 
is at least 1. 

Proof. For the first marked mesh pattern note that 2143 © 2 4 = 24153 and 2143 ©4 
2 = 31524. For the second marked mesh pattern note that (2143 ©4 1) 6 4 = 
426153. □ 



We can also use these patterns to describe Gorenstein Schubert varieties: 
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Theorem 27. Let 7r e 5„. The Schubert variety is Gorenstein if and only if 
it is balanced and avoids the pattern 



Proof. Similar to the proof of Theorem ^6 




□ 



In [3] Billey and Warrington introduced 123-hexagon avoiding permutations as 
permutations avoiding the classical patterns 123, 53281764, 53218764, 43281765, 
432187650 We now show how these four patterns can then be combined into one 
marked mesh pattern. 

Proposition 28. A permutation n is 123-hexagon avoiding if and only if it avoids 
123 and the marked mesh pattern 

m 



-1st 

Proof. The "if" part is easily verified. Now assume 7r contains the marked mesh 
pattern. Let x, y, z, w correspond, respectively, to elements in the marked regions, 
read clockwise and starting at the top. Let us assume that it l {x) < 7r'(z) and y < w, 
as the other cases are similar. Then tt contains the pattern 53281764. □ 

Billey and Warrington also showed that 123-hexagon avoiding permutations can 
be characterized by the avoidance of 123 and the avoidance of a hexagon in the 
heap of the permutation. See [3]. 

Tenner [24] studied^ permutations avoiding 123 and 2143 and showed that a 
permutation n avoids these two patterns if and only if it is boolean in the sense that 
the principal order ideal in strong Bruhat order B(tt) is Boolean (that is, isomorphic 
to the Boolean poset B r of subsets of [r] for some r). So we immediately get that 
a Boolean permutation is 123-hexagon avoiding. 

The author is working with a coauthor on determining which patterns control 
local complete intersections. The two marked mesh patterns that appear for Schu- 
bert varieties defined by inclusions appear in the description along with one other 
marked mesh pattern. 

We end with a diagram in Figure [4~3] that shows which pattern definitions sub- 
sume which. 

There are still other definitions of permutation patterns such as grid patterns, 
defined by Huczynska and Vatter |16j . I do not know where they fit into the 
hierarchy in Figure [4~3] 
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Actually they introduced 321-hexagon avoiding permutations as permutations avoiding the 
reverse of the patterns listed here. We consider the reversed definition to be compatible with what 
has appeared above. 

ctually, permutations that avoid the reverse of these patterns where considered. 
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marked mesh 



McGovern 



mesh 





1-barred 



interval 



bivincular 



Bruhat-restricted 



vincular 



classical 



Figure 4. A diagram showing a hierarchy of permutation pattern 
definitions, f-barred refers to barred patterns with one bar 
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